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ABSTRACT 


The  solution  of  a set  of  v linear  equations  L s *d  , where  L is 

m m m m 

an  mth  order  Hermitian  Toeplitz  matrix  and  the  elements  of  d possess  a 

m 

Hermitian  symmetry,  is  considered.  A specialized  algorithm  is  developed 

2 

for  this  case  which  solves  for  s in  approximately  1.5m  "operations," 

m 

whereas  the  Hermitian  case  of  an  algorithm  developed  by  Zohar  solves  for 

2 

s^  in  approximately  2m  "operations."  An  "operation"  is  used  here  to 

denote  one  addition  and  one  multiplication.  A further  reduction  in 

computational  requirements  is  shown  in  case  L and  d are  real.  As  with 

m m 

Zohar' s algorithm,  the  specialized  algorithm  requires  that  all  principal 

minors  of  L be  nonzero, 
m 

KEY  WORDS  AND  PHRASES:  Linear  algebra,  linear  equations,  Toeplitz  matrix, 

computer  programming 

CR  CATEGORIES:  5.14,  5.25 


1.  Introduction 


Consider  the  set  of  linear  equations 


L s «d 
mm  ra. 


(1) 


Zohar  [1]  makes  use  of  the  Trench  algorithm  [2],  [3]  to  develop  an 

efficient  algorithm  for  solving  (1)  when  s , d are  mxl  matrices  and 

mm 

L is  a non-Hermitian  mth-order  Toeplitz  matrix.  In  this  paper,  an 
m 

efficient  algorithm  is  developed  for  solving  (1)  when  L is  a Hermitian 

m 

Toeplitz  matrix  and  d satisfies 

m 


* ~ 

d -d  , 
m ra 


(2) 


where  the  symbol  ' is  used  to  denote  the  reversed  ordering  of  the 

elements  of  d , i.e.,  (d  ).  *(d  )..  . , and  * denotes  complex  conjugate, 

m m 1,1  m nrn— 1,1 

Such  a specialized  case  can  arise,  for  example,  in  the  design  of  digital 
filters,  as  discussed  in  [4].  The  following  example  serves  to  illustrate 
how  such  a system  of  equations  can  arise. 


EXAMPLE.  Let  a(t),  B(t),  y(t)  be  Jointly  wide-sense  stationary  complex- 
valued stochastic  processes  with  a(t)“B(t)4y(t) , where  E(B (t)y*(s) }“0 
for  all  real  t and  s and  E{*}  denotes  statistical  expectation.  On  the 

basis  of  the  observation  vector  a (k) , a (k)«[a(k)  a(k-l) • • •a(k-nrt-l) ] , 

m in 

where  the  symbol  ' denotes  matrix  transpose,  it  is  desired  to  compute  a 

linear  minimum  mean-square  error  (MMSE)  estimate  of  8(k-p),  i.e.,  it  is 

- 2 

desired  to  minimize  the  quantity  E{|s  a (k)-B(k-p)|  } with  respect  to  s . 

mm  m 

It  is  easily  shown  that  the  desired  solution,  s , satisfies  (1),  with 

in 

L “E{a  (k)a  (k) } and  d "E{8(k-p)a  (k)}.  Since  a(t)  is  wide-sense 
m m ra  in  in 

stationary,  L is  a Hermitian  Toeplitz  matrix.  With  p*(nH-l)/2,  it  is 
m 

easily  seen  that  (2)  is  satisfied  since  8(t)  and  y(t)  are  Jointly  wide-sense 


•*vy;  '«  - t-TT~:  --r~ 


stationary. . 


A useful  consequence  of  the  assumptions  that  d *d  and  L «L  is  that 

r m m m m 

* * 

s "s  . Define  E to  be  the  mxm  exchange  matrix  of  Zohar  [3],  i.e., 
mm  m 

E a -a  for  any  mxl  matrix  a . Note  that  E E *1  , where  I is  the  mxm 
mmm  m mmm  m 

Identity  matrix.  Since  L is  persymmetric  [3],  E L E *L  . Since 

m in  m id  m 

d -d  , from  (1)  we  have  E L (E  E ) 8 »L  8 , so  that  L 8 »L  8 , i.e., 
mm  mmm  mmm  m mmmm 

* * 

8 * 8 . 

m m 

The  specialized  algorithm  developed  in  Section  3 of  this  paper  solves 

2 

(1)  with  d satisfying  (2)  in  approximately  1.5m  complex  "operations," 
m 

whereas  the  Hermitian  case  of  Zohar's  algorithm  [1]  uses  approximately 
2 

2m  complex  "operations."  An  "operation"  is  used  here  to  denote  one 

addition  and  one  multiplication.  In  case  L ,d  (and  hence  s ) are  real, 

mm  m 

2 

the  results  of  Section  3 can  be  used  to  solve  (1)  in  approximately  1.25m 

2 

real  multiplications  and  1.5m  real  additions. 

Both  Zohar's  algorithm  [1]  and  the  specialized  algorithm  developed 
in  Section  3 make  use  of  Phase  1 of  the  Trench  algorithm  [1]— [3] . Rather 
than  review  the  results  necessary  for  the  development  of  Section  3,  it  is 
assumed  that  the  reader  is  familiar  with  the  work  of  Zohar  13]. 


2.  Preliminaries 

Since  the  techniques  used  in  this  paper  are  inherently  related  to 
those  used  by  Zohar  [1],  an  attempt  is  made  to  follow  the  same  notational 
conventions.  Greek  letters  are  used  for  scalars,  capital  letters  for 
square  matrices,  and  lower-case  letters  for  column  matrices.  Subscripts 
used  on  matrices  are  used  to  denote  the  number  of  elements  in  one  column 
of  the  matrix. 

Since  Phase  1 of  the  Trench  algorithm  requires  that  all  principal 
minors  of  1.  be  nonzero,  it  is  assumed  that  (1)  has  been  normalized  so 

IQ 

that  L has  ones  along  its  main  diagonal. 


3.  The  Specialized  Algorithm 

Consider  the  system  of  equations  L s -d  , where  L Is  an  mth  order 
J M m m m m 

* * 

normalized  Hennitlan  Toeplltz  matrix  and  d -d  , so  that  d may  be 

in  m m 

r * * 

written  as  dm"l£ml * * ^2  ^2  ***  ^nr»-l  ^or  m odd  and 

T"  ~2~ 

d ■[  4 •••  £ 4 4 •••  4 ] for  m even.  For  m even  or  odd  we  may  write 

in  in  oil  — 

2 11  2 


di+2* 1 4 i+3  dA  4 1+3  ],  for  1-1,2, * * * ,m-2  where  [x]  denotes  the  largest 


[^1  * [^1 


Integer  less  than  or  equal  to  x.  The  Hermltlan  Toeplltz  nature  of  L 


m 


enables  us  to  write 
1 


ui+2 


1+1 


rl+l  Ll+1 


"1+1 

'* 

rl+l 


1+1 


(3) 


where  r [ p 2 * * *Pi+3 1 (0<i<m-2) . Clearly,  (3)  may  be  rewritten  as 


"i+2 


i r 


1+1 


ri  Li 
ri+i 


'O' 

V 

sl+2~ 

8i 

•m 

°i 

0 

ei 

. - 

Defining  L1+2  s1+2  -d1+2  (l<_l<m-2),  we  have  L1+2 


where  0^»  4 i+3  - r^s^  and  0^  Is  an  lxl  column  matrix  of  zeros. 


Recursive  relationships:  ri^“  -pi+l_ei  ri* 


'i+1 


-1 

Wi  ei 


,-l 
ni  Ai 


i A^_^“A^—  I | A^  • 


Finally,  Phase  1 of  the  Trench  algorithm  and  (6)  may  be  combined  by 
noting  that 


sr  h 


(7) 


and 


s^U-IpjV1 


h ~pi  h 


,*  * 

£i  ~pi  h 


(8) 


An  immediate  consequence  of  (6),  (7),  and  (8)  is  that  8±+2“Bl+2 
since  A^+^  is  real-valued.  Consequently,  there  are  two  sources  of 


increased  computational  speed  in  the  specialized  algorithm:  (i)  s^^  need 
only  be  computed  for  i"l,3,5, • • • ,m-2  when  m is  odd  and  for  i"2,4,6, • • • ,m-2 

i+3 

when  m is  even,  and  (ii)  approximately  half  ([— ^— ])  of  the  elements  of  , 

si+2  neec*  t0  *3e  computed  using  (6),  the  remaining  elements  being  obtained 

* 

from  the  relationship  s^+2“si+2*  T^e  following  is  a summary  of  the 
algorithm. 

r 

1 


PROBLEM  FORMULATION:  L 8 -d  ,L  - 

m m m m 


m-1 


r . L . 
m-1  m-1 


ri”fplp2  " *Pi J (l<i<«-l). 


di+2“f  ^ i+3  di  * ,1+3 J ’ anf  ? 
l 2 * l 2 * 


■ 


Initial  values 


2 

: er  -pi  * » 


sr  ei  ,s2”xi 


q-Pi  q 


ei  ~pi 


Recursive  relations:  Compute  ei+^*  and  Ai+1  ^or 

Compute  9^  and  si+2  for  i " 1,3,5,*«»,  m-2  for  m odd  and 
i - 2,4,6,*-*,  m-2  for  m even. 

ni " 'p1+reiri 


ei  + Vi1** 


, , ,2.-1 

Xi+l“Ai"  ni ' Xi 


V*i±3  ' riSi 
l 2 J 


® -1  1 * _i 

Si+2*  9i  + Xi+l°l  e*  + °i0i  ei+l 
0 1+1  ; 

i+3 

Making  use  of  the  fact  that  only  [— y]  elements  of  need  be 

2 

computed,  the  above  algorithm  requires  approximately  1.5m  additions  and 

2 2 

1.5m  multiplications  for  the  solution  of  s . This  compares  with  2m  for 

m 

the  Hermitian  case  of  Zohar's  algorithm  [1]. 

In  case  L , d (and  hence  s ) are  real,  an  even  further  reduction  in 
mm  m 

computational  requirements  results.  For  this  case  (6)  may  be  rewritten  as 


Si+2"  8i  + Xi+1  °1 


. (9) 


F v 


FORTRAN  routine,  called  SYMM,  presented  in  [5].  The  time  needed  (in 

seconds)  for  each  routine  to  compute  s for  this  example  with 

in 

me  {10,50,100,500}  is  indicated  in  the  following  table. 


M 

TPSLV 

SYMM 

10 

.005 

.005 

50 

.089 

.057 

LOO 

.343 

.217 

500 

8.266 

5.233 

The  above  results,  obtained  on  a CDC  6400  computer,  agree  with  the 
computational  considerations  presented  above. 


4.  Concluding  Remarks 


An  algorithm  has  been  developed  for  the  solution  of  a specialized 
set  of  Toeplitz  linear  equations  that  arise  in  linear  filtering  appli- 
cations. The  savings  in  computational  requirements  of  the  new  algorithm 
over  the  results  of  Zohar  [1]  are  approximately  25%  for  the  Hermitian 
case  and  37.5%  for  the  real  case.  Finally,  it  is  noted  that  the 
techniques  used  in  developing  the  specialized  algorithm  can  indeed  be 
applied  to  the  general  case  treated  by  Zohar  [1];  however,  such  a 
development  results  in  an  algorithm  having  no  computational  advantage 
over  the  generalized  algorithm  of  [1], 


r ! 

I i 


- * 


j 
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